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An  existing  shape  extraction  techniques  that  are  based  on  photometric  measurements  rely  on 
assumed  surface  reflection  properties.  -i>le  pro  pas#  jL  method;for  determining  the  shape  of 
surfaces  whose  reflectance  properties  may  vary  from  Lambertian  to  specular  without  prior 
knowledge  of  the  relative  strengths  of  the  Lambertian  and  specular  components  of  reflection. 
The  object  surface  is  illuminated  using  extended  light  sources  and  is  viewed  from  a  single 
direction.  Surface  illumination  using  extended  sources  makes  it  possible  to  ensure  the  j 

detection  of  both  Lambertian  and  specular  reflections.  Multiple  source  directions  are  used  i 
to  obtain  an  image  sequence  of  the  object.  An  extraction  algorithm  uses  the  set  of  image  | 
intensity  values  measured  at  each  surface  point  to  compute  orientation  as  well  as  the  relatij 
strengths  of  .the  Lambertian  and  ^ecular  reflection  components.  The  proposed  method  has  i 
been  named  "photometric  sampling*^  as  it  uses  samples  of  a  photometric  function  that  relates  ' 
image  intensity  to  surface  orientation,  reflectance,  and  light  source  characteristics  that 
describes  the  reflectance  model  and  orientation  of  a  surface  point.  Experiments  were 
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conducted  on  Lambertian  surfaces,  specular  surfaces,  and  hybrid  surfaces  whose  reflectance 
model  is  composed  of  both  Lambertian  and  specular  components.  The  results  show  high 
accuracy  in  measured  orientations  and  estimated  reflectance  parameters.  A' 
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Abstract 


All  existing  shape  extraction  techniques  that  are  based  on  photometric  measurements 
rely  on  assumed  surface  leflecdon  properties.  We  propose  a  method  for  determining  the 
shape  of  surfaces  whose  reflectance  properties  may  vary  from  Lambertian  to  specular  without 
prior  knowledge  of  the  relative  strengths  of  the  Lamberdan  and  specular  components  of 
reflecdon.  The  object  surface  is  illuminated  using  extended  light  sources  and  is  viewed 
from  a  single  diiecdon.  Surface  illuminadon  using  extended  sources  makes  it  possible  to 
ensure  the  detecdon  of  both  Lamberdan  and  specular  reflecdons.  Mii..:  'e  source  directions 
are  used  to  obtain  an  image  sequence  of  the  object.  An  extraction  air  >rithm  uses  the  set 
of  image  intensity  values  measured  at  each  surface  point  to  compute  orientation  as  well  as 
the  reladve  strengths  of  the  Lamberdan  and  specular  reflecdon  components.  The  proposed 
method  has  been  named  "photometric  sampling”  as  it  uses  samples  of  a  photometric  funcdon 
that  relates  image  intensity  to  surface  orientadon,  reflectance,  and  light  source  characterisdcs. 
that  describes  the  reflectance  model  and  orientadon  of  a  surface  point.  Experiments  were 
conducted  on  Lambertian  surfaces,  specular  surfaces,  and  hybrid  surfaces  whose  reflectance 
model  is  composed  of  both  Lambertian  and  specular  components.  The  results  show  high 
accuracy  in  measured  orientations  and  estimated  reflectance  parameters. 
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1  Introduction 


For  a  given  illumination,  the  brightness  or  intensity  distribution  in  the  image  of  an  object 
is  related  to  its  surface  shape.  The  first  efforts  in  determining  the  shape  of  an  object  from 
image  intensities  were  made  by  Horn  [4].  More  popularly  known  as  "shape  from  shading," 
his  method  attempts  to  determine  object  shape  from  a  single  image  of  the  object  by  studying 
the  variation  of  intensities  in  the  image.  Horn  formulated  the  problem  as  a  first  order  partial 
differential  equation  and  proposed  a  solution  to  the  equation  by  using  the  characteristic  strip 
expansion  method.  By  starting  with  a  seed  point  of  known  orientation,  the  orientations  of 
points  may  be  computed  along  strips  that  originate  from  the  seed  point.  The  reliability  of 
the  approach  greatly  depends  on  the  selection  of  the  starting  point.  Later,  Ikeuchi  and  Horn 
[9]  developed  a  shape  from  shading  technique  that  uses  the  occluding  boundaries  of  the 
object  and  surface  smoothness  constraints  to  iteratively  compute  surface  orientations  from 
image  intensities.  Both  the  above  methods  are  global  in  that  they  compute  orientations  by 
propagating  previously  computed  orientation  information.  The  first  local  approach  to  shape 
from  shading  was  presented  by  Pentland  [14J;  it  assumes  that  every  small  region  in  the  image 
lies  on  a  spherical  surface.  The  intensity  variations  inside  a  region  are  used  to  find  the  sphere 
that  region  represents.  Local  orientation  is  computed  by  finding  the  location  of  the  region 
on  its  corresponding  sphere.  All  shape  from  shading  methods  make  assumptions  (usually 
Lambertian)  regarding  the  surface  reflection  model  to  compute  orientations.  However,  even 
if  the  surface  reflectance  model  is  accurately  known,  it  is  not  possible  to  find  a  unique  surface 
orientation  from  a  single  image  intensity  value  without  using  additional  shape  constraints. 
For  this  reason,  shape  from  shading  methods  lack  the  generality  that  is  desired  in  a  shape 
extraction  technique. 

The  number  of  possible  orientations  that  a  surface  point  can  have  is  considerably 
reduced  if  multiple  images  of  the  object  are  used  where  each  image  corresponds  to  a  dif¬ 
ferent  illumination  direction.  Hence,  several  shape  extraction  methods  are  based  on  actively 
controlled  object  illuminadon.  Woodham  [21]  proposed  the  theory  for  the  photometric  stereo 
method  that  illuminates  the  object  from  three  different  source  directions  iind  captures  an  im¬ 
age  of  the  object  for  each  source  direction.  The  object  position  and  the  viewing  direction  of 
the  camera  are  kept  unchanged  while  the  source  direction  is  varied.  Tlie  image  intensities 
recorded  at  each  surface  point  uniquely  determine  the  orientation  of  the  surface  point.  This 
mapping  of  intensities  to  orientations  is  possible  only  if  the  reflectance  properties  of  the 
surface  are  known  a-priori.  Silver  [18]  developed  ways  to  apply  the  basic  photometric  stereo 
method  to  surfaces  of  differing  reflectance  properties.  Ikeuchi  [11]  used  photometric  stereo 
to  measure  orientations  of  a  specular  surface  by  illuminating  the  surface  with  extended  light 
sources.  Nayar  and  Sanderson  [13]  extended  Ikeuchi’s  method  by  using  complementary  line 
sources  to  extract  the  shape  of  specular  surfaces.  All  techniques  that  are  developed  on  the 
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basis  of  photometric  stereo  require  knowledge  about  the  surface  reflectance  properties. 

In  recent  years,  the  importance  of  understanding  and  using  specular  leflecdons  has 
been  realized,  and  considerable  effon  is  being  directed  in  this  area.  Klinker,  Shafer,  and 
Kanade  [12]  have  succeeded  in  using  physical  models  to  separate  specular  highlights  from 
color  images  of  objects.  Healey  and  Binford  [3]  have  described  ways  of  inferring  local  second 
order  surface  shape  by  examining  the  image  intensities  in  the  area  of  the  specular  highlight. 
Their  system  is  also  capable  of  predicting  the  appearances  of  specular  highlights  from  surface 
models,  a  feature  that  may  be  used  in  computer  graphics  applications.  Sanderson,  Weiss, 
and  Nayar  [17]  have  implemented  the  structured  highlight  inspection  system  that  determines 
the  shape  of  specular  surfaces.  Their  method  is  based  on  active  sensing;  an  array  of  point 
sources,  positioned  around  the  object,  is  scanned,  and  the  highlights  resulting  from  each 
source  are  used  to  compute  local  orientation  information. 

The  above  mentioned  shape  extraction  methods  rely  on  prior  knowledge  of  surface 
reflectance  properties  in  order  to  extract  surface  shape.  In  many  vision  applications,  the 
reflectance  properties  of  object  surfaces  are  not  readily  available.  Further,  these  methods 
are  only  capable  of  determining  the  shape  of  either  Lambertian  or  specular  surfaces.  An 
extraction  method  must  overcome  these  limitation  to  be  applicable  to  a  variety  of  industrial 
tasks.  Coleman  and  Jain  [2]  have  proposed  a  four-source  photometric  stereo  method  that 
uses  an  extra  light  source  to  detect  and  avoid  specular  reflections.  If  the  surface  point  has 
Lambertian  and  specular  components  of  reflection,  due  to  high  sharpness  of  specularity,  at 
most  one  of  the  four  point  sources  can  generate  specular  reflections  at  that  surface  point.  Very 
high  image  intensities  are  discarded  as  highlight  or  specular  reflections,  and  the  remaining 
Lambertian  intensities  are  used  to  determine  surface  orientations  by  photometric  stereo. 

Although  this  method  was  developed  to  extract  the  shape  of  hybrid  surfaces  whose 
reflectance  models  include  both  Lambertian  and  specular  components  it  can  only  be  applied 
to  surfaces  that  have  a  reasonably  strong  Lambertian  component  of  reflection;  highly  specular 
surfaces,  such  as  smooth  metallic  surfaces,  do  not  fall  under  this  category.  In  practice,  it  may 
be  required  to  extract  the  shape  of  surfaces  of  varying  reflectance  characteristics.  Therefore, 
it  is  desirable  to  have  a  method  that  can  extract  the  shape  of  Lambertian,  specular,  and  hybrid 
surfaces. 

Yet  another  limitation  of  all  existing  extraction  methods  is  their  inability  to  furnish 
information  regarding  the  reflectance  properties  of  the  object  surface.  In  many  industrial  ap¬ 
plications,  surface  polish  and  surface  roughness  are  found  to  be  important  inspection  criteria. 
In  such  cases,  surface  reflectance  properties  may  be  interpreted  as  measures  of  surface  polish 
and  roughness.  Further,  reflectance  properties  may  be  used  to  segment  an  image  in  different 
regions;  each  region  may  be  regarded  as  a  different  surface  to  aid  the  process  of  inspection. 
For  these  reasons,  it  would  be  of  great  value  to  have  a  technique  that  could,  in  addition  to 
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determining  shape,  also  estimate  the  reflectance  properties  of  each  surface  point. 

This  paper  presents  a  method  for  determining  the  shape  of  objects  whose  surfaces 
are  Lambertian,  specular,  or  hybrid.  Shape  information  is  extracted  without  prior  knowledge 
of  the  relative  strengths  of  the  Lambertian  and  specular  reflection  components.  The  method 
also  determines  the  parameters  of  the  reflectance  model  at  each  surface  point.  The  proposed 
method,  called  photometric  sampling,  uses  extended  light  sources  to  illuminate  the  object 
surface.  A  sequence  of  images  of  the  object  is  generated  by  changing  the  extended  source 
position.  An  extraction  algorithm  uses  the  image  intensity  values  recorded  at  each  surface 
point  to  locally  estimate  orientation  and  reflectance  information.  A  prototype  implementation 
of  the  photometric  sampling  method  was  used  to  conduct  experiments  on  Lambertian,  spec¬ 
ular,  and  hybrid  surfaces.  The  experimental  results  have  shown  high  accuracy  in  extracted 
object  shape  and  surface  reflectance  properties. 

2  Photometric  Sampling 

The  intensity  distribution  in  the  image  of  an  object  is  closely  related  to  the  reflectance 
properties  and  shape  of  the  object  surface,  and  the  characteristics  of  the  light  source  used  to 
illuminate  the  object.  The  basic  photometric  function^  is  defined  as  one  that  relates  image 
intensity  to  surface  orientation,  surface  reflectance,  and  source  position  for  point  source 
illumination  of  the  surface.  Point  light  sources  are  most  often  used  to  illuminate  a  scene  of 
interest.  However,  the  ease  of  using  point  sources  comes  with  the  inability  to  capture,  in  the 
image  intensities,  the  information  that  is  required  to  extract  surface  features  such  as  shape 
and  reflectance.  We  propose  an  extended  light  source  illumination  method  to  overcome  the 
inadequacies  of  point  source  illumination.  The  basic  photometric  function  is  modified  for 
object  illumination  using  extended  sources.  Samples  of  the  modified  photometric  function 
may  be  obtained  by  illuminating  the  surface  from  different  source  directions.  In  the  next 
section,  we  will  develop  an  algorithm  for  determining  surface  orientations  and  reflectance 
properties  from  the  measured  photometric  samples.  For  ease  of  description,  photometric 
sampling  is  described  here  by  using  a  two-dimensional  illumination  and  imaging  geometry. 
Later,  these  results  are  extended  to  three  dimensions. 

2.1  Basic  Photometric  Function 

Consider  the  illumination  of  an  object  by  a  point  source  of  light,  as  shown  in  Figure  1. 
The  point  source  emits  light  in  all  directions.  Light  energy  reflected  by  the  surface  in  the 

‘The  photometric  function  is  similar  to  the  image  inadiance  [6]  equation,  since  image  intensity  is  assumed 
to  be  proportional  to  image  inadiance. 


direction  of  the  camera  causes  an  image  of  the  surface  to  be  formed  in  the  camera.  For  a 
pven  orientation  of  the  surface  and  direction  of  the  point  source,  the  amount  of  light  energy 
reflected  by  the  surface  in  a  particular  direction  is  determined  by  its  reflectance  properties. 
The  reflectance  model  of  a  large  number  of  surfaces  comprises  two  components,  namely, 
the  Lambertian  (diffuse)  component  and  the  specular  (gloss)  component.  In  general,  the 
energy  of  light  reflected  by  a  surface  in  any  direction  is  a  combination  of  the  Lambertian 
and  specular  components.  Therefore,  the  intensity  at  an  image  point  may  be  expressed  as: 

/  =  /L+/5,  (1) 

where  IL  is  the  image  intensity  due  to  Lambertian  reflection  and  75  is  the  image  intensity 
due  to  specular  reflection. 


Point 

Source 


Figure  1:  Two-dimensional  illumination  and  imaging  geometry.  A  surface  element  with 
orientation  6^  reflects  light  flrom  the  point  source  ctirection  B,  into  the  camera. 


We  will  express  the  two  components  of  image  intensity  in  terms  of  the  parameters  that 
describe  the  two-dimensional  imaging  and  illumination  geometry  shown  in  Figure  1.  In  two 


dimensions,  the  source  direction  vector  s,  surface  normal  vector  n,  and  viewing  direction 
vector  V  lie  in  the  same  plane.  Therefore,  any  direction  may  be  represented  by  a  single 
parameter,  namely,  the  azimuth  angle  6. 

The  Lambertian  component  IL  results  from  the  non-homogcneous  nature  of  the  lay* 
ers  that  constinite  the  object  surface.  Light  rays  penetrating  the  surface  undergo  multiple 
refractions  and  reflections  at  the  boundaries  between  surface  layers  and  leemerge  near  the 
point  of  entry  with  a  variety  of  directions.  These  surfaces  appc^  equally  bright  from  all 
directions;  the  intensity  component  IL  is  independent  of  the  viewing  direction.  However,  the 
brighmess  of  a  Lambertian  surface  point  is  proportional  to  the  energy  of  incident  light.  As 
seen  in  Figure  1,  the  amount  of  light  energy  falling  on  the  surface  element  is  proportional 
to  the  area  of  the  surface  element  as  seen  from  the  point  source  position,  often  referred  to 
as  the  foreshortened  area.  The  foreshortened  area  is  a  cosine  function  of  the  angle  between 
the  surface  orientation  direction  9^  and  the  source  direction  d,.  Therefore  the  Lambertian 
intensity  component  IL  may  be  written  as; 

IL  =  Acosid,-e„),  (2) 

where  A  is  a  constant  of  proportionality. 

Various  specular  reflectance  models  have  been  developed  over  the  years.  The  Torrence 
and  Sparrow  model  [20]  has  received  considerable  attention  in  recent  years  as  it  is  one 
of  the  first  models  derived  by  studying  the  physics  underlying  specular  reflection.  This 
model  assumes  that  a  surface  is  composed  of  small,  randomly  oriented,  mirror*like  facets. 
The  specular  intensities  predicted  by  the  model  were  in  good  agreement  with  experimental 
results  for  both  metals  and  non-metals  [20].  By  using  this  model,  the  relationship  between 
the  specular  intensity  IS,  surface  orientation  9^,  and  source  direction  9^  may  be  written  as: 

where: 


The  term  C  represents  the  characteristics  of  the  light  source  used  to  illuminate  the  surface. 
The  Fresnel  coefficient  F  models  the  fraction  of  incident  light  that  is  reflected  by  an  individual 
facet.  The  Fresnel  equations  predict  that  F  is  a  nearly  constant  function  of  angle  of  incidence 
for  materials  that  have  a  significant  specular  reflection  component  [19].  The  probability 
distribution  function  F(r/)  describes  the  orientation  of  the  microfacets  with  respect  to  the 
mean  surface  orientation  9„.  Most  often,  the  Gaussian  distribution  function  is  used  for 
P{r)).  The  factor  G  quantifies  the  geometrical  attenuation  of  reflected  light  energy  due  to  the 
shadowing  and  masking  of  facets  by  adjacent  facets. 
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The  Torrance  and  Sparrow  model  was  developed  with  the  primary  objective  of  de¬ 
scribing  the  phenomenon  of  off-specular  reflecdon  from  roughened  surfaces.  For  rough  sur¬ 
faces,  the  peak  in  reflected  intensity  was  observed  when  the  angle  of  reflection  was  greater 
than  the  angle  of  incidence.  This  effect  was  attributed  to  the  term  GjcosBn  in  equation  3. 
In  the  experiments  conducted  by  Torrence  and  Spai  ow,  reflected  intensity  was  measured 
by  varying  the  viewing  direction  while  the  source  direction  was  kept  constant  Therefore, 
for  viewing  directions  close  to  the  grazing  angle,  cosB^  approaches  zero  and  the  reflected 
intensity  attained  very  high  magnitudes. 

The  goal  of  this  paper  is  to  extract  surface  properties  by  changing  the  source  direction 
while  keeping  the  viewing  direction  constant  Hence,  for  all  image  intensities  measured  at 
the  same  surface  point  the  term  cosdt,  is  constant.  Further,  as  the  source  direction  is  varied 
the  distribution  function  P{ri)  changes  much  faster  that  the  geometrical  attenuation  factor  G 
[3].  Since  Piji)  has  a  maximum  value  at  d.  »  2$^,  the  specular  intensity  IS  is  maximum 
when  «  2dn.  Therefore,  if  the  source  direction  is  varied,  rather  than  the  viewing  direction, 
a  peak  in  the  reflected  intensity  is  expected  when  the  angle  of  reflection  equals  the  angle  of 
incidence. 

In  this  paper,  we  focus  our  attention  on  smooth  surfaces.  For  such  surfaces,  the 
microfacet  orientation  distribution  may  be  described  using  a  Gaussian  distribution  of  very  low 
variance.  The  resulting  specular  intensity  IS  is  a  very  sharp  function  of  the  source  direction 
6t.  Therefore,  the  specular  reflectance  model  given  by  equation  3  can  be  approximated  by  a 
unit  impulse  function: 

=  2^„), 

where: 

u{9,  -  2^„)  «  lim  L  6i0  -20n)dB^ 

The  basic  photometric  function  relates  image  intensity 
flectance,  and  source  direction  and  may  be  written  by 
equation  1: 

I  •A  cosie,  u(.9,  -  29n) .  (5) 

The  constants  A  and  B  in  equation  5  represent  the  relative  strengths  of  the  Lambertian  and 
specular  components  of  reflection.  We  see  that,  A  >  0  and  =  0  for  a  purely  Lambertian 
surface,  A  =  0  and  >  0  for  a  purely  specular  surface,  and  A  >  0  and  5  >  0  for  a  hybrid 
surface. 

Our  objective  is  to  determine  orientation  and  reflectance  at  each  surface  point  from  a 
set  of  image  intensities  that  result  from  changing  the  source  direction  9,.  As  seen  in  Figure  1, 
by  moving  the  source  around  the  object,  we  can  vary  the  source  direction  without  changing 


(4) 

1  if^,  *2^„ 

- 

0  otherwise 

to  surface  orientation,  surface  re¬ 
substituting  equations  2  and  4  in 
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the  surface  orientation  and  reflectance  parameters.  Therefore,  even  though  the  orientation 
and  reflectance  parameters  are  unknown,  we  can  treat  them  as  constants  in  equation  5.  For 
this  reason,  we  will  often  refer  to  the  basic  photometric  function  as  a  relation  between 
image  intensity  and  source  direction.  Figure  2  shows  plots  jf  the  basic  photometric  function 
for  Lambertian,  specular,  and  hybrid  surfaces. 


2.2  Why  Extended  Sources  ? 

/ 

Numerous  point  source  illumination  methods  [21-[1  V[  i7],[21]  have  been  proposed  that  ex¬ 
tract  the  shape  of  either  Lambertian  or  specular  surfaces.  There  is  no  single  photometric 
method  available  that  can  measure  the  shape  of  Lambertian,  specular,  and  hybrid  surfaces. 
A  problem  associated  with  the  use  of  point  sources  h  tliat  the  specular  component  of  reflection 
is  not  detected  unless  the  =  16,^.  In  order  to  determine  shape  and  reflectance  parameters  of 
hybrid  surfaces,  both  specular  and  Lambertian  reflections  must  be  captured  in  the  measured 
intensities.  To  detect  specular  reflections  horn  surface  points  of  all  orientations,  an  infinite 
number  of  point  sources  need  to  be  positioned  around  the  surface.  Such  an  approach  is 
unrealistic  from  the  perspective  of  practical  implementation  [17],  The  photometric  sampling 
method  uses  multiple  extended  light  sources  to  illuminate  the  object  surface.  Unlike  a  point 
source,  an  extended  source  emits  light  from  an  area  of  points  .uther  than  a  single  point.  This 
characteristic  of  an  extended  source  may  be  used  to  ensure  the  detection  of  both  Lambertian 
and  specular  components  of  reflection. 

Experiments  have  shown  [3], [17]  that  for  point  source  illumination,  it  is  also  difficult 
to  measure  both  Lambertian  and  specular  reflections  without  changing  the  sensitivity  of  the 
measuring  device.  Image  intensities  due  to  specular  reflections  have  been  observed  to  be 
much  higher  than  intensities  resulting  from  Lambertian  reflections.  Therefore,  when  the 
sensitivity  of  a  camera  is  adjusted  to  detect  Lambertian  reflections,  the  specular  reflections 
result  in  saturated  image  intensities.  When  the  sensitivity  is  adjusted  to  measure  intensities  of 
specular  reflections,  the  intensities  due  to  Lambertian  reflections  are  too  low  to  be  detected. 
Extended  source  illumination  tends  to  make  the  image  intensities  due  to  Lambertian  and 
specular  reflections  comparable  to  one  another.  For  extended  source  illumination,  a  specular 
surface  element  of  a  given  orientation  will  reflect  light  from  a  small  area  on  the  extended 
source  into  the  camera.  On  the  other  hand,  a  Lambertian  surface  element  of  the  same 
orientation  reflects  light  from  all  points  on  the  extended  source.  This  feature  of  the  proposed 
illumination  scheme  makes  it  possible  to  detect  both  Lambertian  and  specular  reflections  in 
the  same  image. 

An  extended  source  may  be  generated  by  illuminating  a  layer  of  light-diffusing  ma¬ 
terial  with  a  point  source  of  light.  The  radiance  at  any  point  on  the  extended  source  is 
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determined  by  the  illumination  geometry  and  the  shape  of  the  diffuser.  In  order  to  use  im¬ 
age  intensities  resulting  froth  extended  source  illumination,  we  need  to  know  the  radiation 
characteristics  of  the  extended  source.  The  radiance  function  9t)  for  an  extended  source 
of  a  particular  geometry  is  derived  in  Appendix  A.I.  The  position  of  an  extended  source  is 
determined  by  the  direction  of  the  point  source  used  to  generate  the  extended  source.  The 
radiance  function  L(^,  ^i)  is  symmeoic  with  respect  to  ^  «  d,  wd  its  magnitude  decreases 
as  $  deviates  from  Bt.  All  extended  sources  have  a  width  of  2a,  and  L{B,  $t)  s  0  for  d 
<  Bf-ck  and  B  >  Bt+a.  We  will  refer  to  a  as  the  source  termination  angle  of  an  extended 
source.  Radiance  functions  for  both  two-dimensional  and  three-dimensional  extended  source 
are  given  in  Appendix  A.  These  results  will  be  extensively  used  in  the  following  discussions. 

2.3  Photometric  Function  for  Extended  Sources 

Tue  photometric  function  for  point  source  illumination  (equation  S)  needs  to  be  modified  for 
extended  source  illumination.  An  extended  source  may  be  thought  of  as  a  collection  of  point 
sources  where  each  point  source  has  a  radiant  intensity  that  is  dependent  on  its  position  on  the 
extended  source.  The  intensity  of  light  reflected  by  an  object  surface  that  is  illuminated  by 
an  extended  source  may  be  determined  by  computing  the  integral  of  the  light  energy  reflected 
from  all  points  on  the  extended  source.  Therefore,  the  modified  photometric  function  /'(B^) 
is  determined  by  convolving  the  basic  photometric  function  1(6)  with  the  extended  source 
radiance  function  B,).  This  operation  is  illustrated  in  Figure  3. 

For  a  surface  point  of  orientation  B„,  the  Lambertian  component  IV  of  the  modified 
photometric  function  is  determined  as: 

IV  *  A  LiB,  Bt)co5{B  -B^)(iB.  (6) 

JBt-ot 

The  limits  of  the  integral  are  determined  by  the  width  of  the  extended  source  (see  Ap¬ 
pendix  A).  In  order  to  compute  the  above  integral,  we  will  use  the  trigonometric  indentity: 

cosifi  -  Bn)  «  cosB  cosB„  +  sinB  sinBn-  (7) 

Equation  6  may  thus  be  written  as: 

IV  -  aI*  LiB,B,)cosBcosBndB 
JBi-ol 

+  A  f.*  LiB,  Bt)  sinB  sinBn  dB .  (8) 

JBt~a 
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Figure  3:  The  photometric  function  for  extended  source  illumination  is  obtained  by  convolv 
ing  the  basic  photometric  function  with  the  extended  source  radiance  function. 


By  making  the  substitutions: 

cosd  a  cos(6  -  dt  +  9t)  (9) 

and: 

sind  a  sin{$  -  +  ^,)  (10) 

in  equation  8,  we  obtain: 


IV 


A  cosdu  cosd,  L  Lid,  d,)  cosid  -  d,)  dd 
Ju,-Ct 

rd,+a 

-  A  cosda  sind,  L(6,  d,)  sinid  -  9,)  dd 

Jd,—<k 

fd,*a 

+  A  sindn  cosd.  Lid ,  ^,)  sinid  -  9^)  dd 

Jd,-a 

fd,*a 

+  A  sinda  sirtd.  Lid,  d,)  cosid  -  d,)  dd 
Jd,~Ol 


(11) 


The  extended  source  radiance  Lid,  9,)  is  an  even  function  about  the  point  d  »  d, 
while  sinid  —  d,)  is  an  odd  function  about  the  point  d  a  Therefore,  the  second  and  third 
integrals  are  equal  to  zero  and  the  above  equation  may  be  simplified  and  written  as: 


IV  a  A' cosid,- dr). 


(12) 


where: 


(13) 


Both  functions  Lid,d,)dSid.  cosid  -  d,)  in  equation  13  are  symmetric  about  9  »  d,  lot  all 
extended  source  directions  9,.  Thus,  the  value  of  the  A'  is  independent  of  the  extended 
source  direction  d,.  It  is  interesting  to  note  that  the  Lambertian  component  of  the  modified 
photometric  function  is  only  a  scaled  version  of  the  Lambertian  component  of  the  basic 
photometric  function.  This  result  is  a  consequence  of  using  an  extended  source  whose 
radiance  function  L{d,  d,)  is  symmetric  with  respect  to  its  direction  d,. 


On  similar  lines,  the  specular  intensity  component  IS'  resulbrig  from  the  extended 
source  Lid,  d,)  is  determined  as: 


or: 


IS'  a  B Lid, d,) bid  -  idr) dd , 


(14) 


IS'  =  BLi2dn,d,). 


(15) 
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If  a  more  accurate  specular  reflection  model  is  used  [20],  rather  than  a  unit  impulse 
function,  the  result  of  the  integral  would  be  different.  However,  for  smooth  surfaces,  the 
specular  intensity  changes  with  the  source  direction  $%  much  faster  than  the  extended  source 
radiance  function  L(9, 6,).  For  such  surfaces,  it  is  reasonable  to  assume  that  the  specular 
intensity  IS'  is  propmtional  to  while  the  constant  of  proportionality  between  IS  and 

varies  with  the  parameters  of  the  specular  reflectance  model  used.  To  this  end,  we 
will  use  the  constant  S',  rather  dian  B,  to  represent  die  strength  of  the  specular  component  of 
the  photometric  function.  The  image  intensity  f  at  a  surface  point  of  orientation  resulting 
from  the  extended  source  L{d,  6^),  is  a  combination  of  the  Lambertian  component  W  and  the 
specular  component  IS': 


r  =  A'  cos(e,  -  e^)  +  b'  l(2^„,  e,) .  (i6) 

Equation  16  is  the  modified  photometric  function  that  relates  image  intensity  to  surface 
orientation,  surface  reflectance,  and  source  position  for  extended  source  illumination.  In  the 
equation,  surface  orientation  and  reflectance  parameters  are  unknown,  but  constant,  for  a 
given  surface  point.  For  this  reason,  we  will  frequently  refer  to  the  modified  photometric 
function  as  /'(d,),  a  relation  between  image  intensity  and  extended  source  direction. 

2.4  Sampling 

The  process  of  measuring  image  intensity  for  different  source  directions  is  equivalent  to 
sampling  the  modified  photometric  function  I'{6,)  as  shown  in  Figure  4.  Samples  of  the 
photometric  function  may  be  obtained  by  moving  an  extended  source  around  the  object  and 
taking  images  of  the  object  for  different  source  positions.  An  alternative  approach  would  be 
to  distribute  an  array  of  extended  sources  around  the  object  such  that  each  source  illuminates 
the  object  from  a  different  direction.  The  entire  array  of  extended  sources  may  be  sequentially 
scanned  such  that  for  each  scan  a  single  source  is  active  and  an  image  of  the  object  surface 
is  obtained.  For  now  we  will  confine  the  sampling  process  to  two-dimensions;  the  surface 
normal  vector,  viewing  direction  vector,  and  source  direction  vectors  for  all  extended  sources 
are  coplanar.  Discrete  extended  source  directions  are  represented  by  0i,  and  the  photometric 
sample  resulting  from  an  extended  source  in  the  direction  is  referred  to  as  I'i.  Therefore, 

the  scanning  process  results  in  a  set  of  image  intensities  {/V  i»l,2 . M}  measured  at  each 

point  on  the  object  surface. 

The  number  of  samples  measured  at  each  surface  point  is  determined  by  the  frequency 
/  at  which  I'(ff,)  is  sampled.  As  stated  earlier,  in  order  to  extract  the  shape  and  reflectance 
parameters  of  hybrid  surfaces,  both  Lambertian  and  specular  components  of  image  intensity 
must  be  detected.  Since  we  have  used  a  unit  impulse  specular  reflection  model,  the  period 
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of  the  photometric  function  that  contains  specular  intensities  is  equal  to  the  width,  2a,  of  the 
extended  source  radiance  function.  In  the  following  section,  we  will  show  that,  in  general, 
at  foast  two  photometric  samples  must  have  non-zero  specular  intensities  for  the  extraction 
technique  to  work.  Hence,  the  photometric  function  must  be  sampled  at  a  frequency  greater 
th^  or  equal  to  the  nunimum  sampling  frequency  where: 

''  ■  (17) 

Ot 


Figure  4:  Sampling  the  modified  photometric  function. 


3  Extracting  Shape  and  Reflectance  of  Surfaces 

Given  th.*,  set  of  image  intensities  {I'i},  we  want  to  determine  the  surface  orientation  dn 
and  the  snengths  A'  and  B'  of  the  Lambertian  and  specular  components  of  reflection.  The 
shape  and  reflectance  properties  extracted  at  each  surface  point  are  solely  based  on  the  image 

^It  is  assumed  that  the  period  of  the  photometric  function  that  contains  specular  intensities  is  small  compared 
to  the  total  width  of  the  photomeuic  function.  Therefore,  sampling  frequencies  that  ensure  the  detection  of 
specular  intensiUes  will  provide  a  sufficient  number  of  Lambertian  intensity  samples. 


intensities  recorded  at  that  point  The  surface  property  values  assigned  to  a  surface  point  are 
not  influenced  by  the  image  intensities  measured  at  neighboring  points.  We  will  first  develop 
techniques  to  extract  surface  orientations  of  purely  Lambertian  and  purely  specular  surfaces. 
Later,  these  techniques  will  be  used  as  tools  to  extract  surface  orientations  and  reflectance 
properties  of  hybrid  surfaces. 


3.1  Lambertian  Surfaces 

Consider  the  case  where  the  surface  of  an  object  is  known  to  be  purely  Lambertian,  and  the 
shape  of  the  object  is  to  be  determined.  The  photometric  samples  for  a  Lambenian  surface 
may  be  written  as: 

A  =  (18) 

We  would  like  to  compute  the  surface  orientation  dn  and  the  strength  A'  of  Lambertian 
reflection  component.  The  variables  0n  and  A'  may  be  estimated  by  fitting  the  Lambertian 
photometric  function  to  the  image  intensities  and  extended  source  directions  d,.  To  this 
end,  an  error  E  is  formulated  as  the  sum  of  the  errors  in  image  intensities  over  the  entire  set 
of  measured  intensities:  ^ 

E  =  EtA-A'coKSi-#.)?.  (19) 

(at 

By  using  the  conditions: 

t-O  and 

we  can  determine  values  of  On  and  A'  that  minimize  the  error  E. 

3.2  Specular  Surfaces 

Now  consider  the  case  where  the  object  surface  is  known  to  be  purely  specular,  and  the 
shape  of  the  object  is  to  be  determined.  We  see  from  equation  16  that  for  a  specular  point 
the  photometric  function  /'(^«)  is  proportional  to  L(20„,  $t) : 

F  (21) 

We  want  to  determine  the  orientation  and  the  specular  strength  B'  from  a  finite  number  of 
samples  of  /'(d*).  As  shown  in  Figure  5,  F{$t)  has  maximum  magnitude  at  9,  »  2d„  and  is 
symmetric  about  that  point.  When  the  orientation  9n  decreases,  /'(d,)  shifts  to  the  left,  and 
when  Bn  increases,  /'(^,)  shifts  to  the  right.  Therefore,  by  finding  the  position  of  the  peak  of 
FiBt),  we  can  determine  Bn. 
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Samples  Fi  of  the  photometric  function  F{6t)  are  related  to  the  extended  source  posi* 
don  as: 


Fi^B'Lae^^di). 


(22) 


Since  B'  is  unknown,  it  is  not  possible  to  find  the  peak  position  of  F($,)  from  a  single  sample. 
However,  since  we  know  the  shape  of  f  (^t),  we  can  find  the  peak  of  F(0t)  from  two  samples 
of  F(6,),  as  shown  in  Figure  S.  Consider  the  samples  fk  and  that  result  from  extended 
sources  positioned  at  and  0k>i>  respectively.  Let  us  assume  that  i^kfi  ~  see  that 

when  Bn  increases,  /'(d,)  shifts  to  the  right,  fk  decreases,  and  /'k+i  increases.  Similarly,  wtie^ 
decreases,  FiBt)  shifts  to  the  left,  F^  increases,  :md  Fit^.\  decreases.  .  ^ 

In  order  to  determine  the  surface  orientation  B^  and  the  sp^ular  strength  from  the 
two  non-zero  image  intensities  fk  andfk^i.  we  define  the  northalized  brightness  difference 
function  Dk(2^R)  as  [13]: 


r)k(2(9n> 


L(2^m^k*l)  +L(2^n,^k)  ■ 


(23) 


The  analytic  expressions  for  L(2d„,  ^k)  hnd  L(2Bn,  dk^-i)  (Appendix  A)  may  be  substituted 
in  equation  23.  As  shown  in  Figure  5,  as  inen^n^s  from  ^k  to  ^kt-i>  ^k(2dn)  varies 
monotdnically  from  Dx(B‘/)  =* -l  fo  'f>k(^k+i)  *  L  Therefore,  if  the  value  of  £)k(2^n)  can  be 
computed  from  measured  image  intensities,  we  can  uniquely  determine  the  orientation  Bn. 

Given  the  image  intensity  set  {/'i}  at  a  specular  surface  point,  the  non-zero  image 
intensities  in  the  set  are  first  determined.  If  only  a  single  intensity  value,  for  instance  /'k, 
is  greater  than  zero,  then  we  know  that  2Bn  »  ^k*  If  two  image  intensities,  for  instance 
F|^  and  fk.^t,  are  greater  than  zero,  the  normalized  brighmess  difference  function  Dk(2Bn)  is 
determined  from  Ft  and  /'k^i  by  using  equations  22  and  23: 


0,(2Bn)  = 


Fm  -  A 
I'm  +/'k  ’ 


(24) 


Given  the  value  of  Dk(2Ba),  we  can  find  orientation  Bn  by  using  equation  23. 


As  shown  above,  surface  orientation  Bn  is  computed  without  prior  knowledge  of  the 
strength  B'  of  the  specular  component  of  reflection.  Once  Bn  is  found,  is  determined  by 
using  equation  22: 


B'  » 


LilBnM’ 


(25) 


3.3  Hybrid  Surfaces 

In  practice,  purely  Lambertian  or  purely  specular  surfaces  are  unlikely  occurrences.  A 
large  number  of  surface:,  may  be  classified  as  hybrid  surfaces  whose  reflectance  models 
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are  composed  of  both  Lambertian  and  specular  components.  Surfaces  of  plastic  objects  are 
examples  of  hybrid  surfaces.  For  extended  source  illuminadon,  the  photometric  function 
for  these  surfaces  is  given  by  equation  16.  The  strengths  >4'  and  &  of  the  Lambertian  and 
specular  components  may  vary  from  surface  point  to  surface  point.  At  each  surface  point,  we 

want  to  determine  A\  B\  and  orientation  6^  from  the  measured  samples  {fit  is*  1,2, . M}  of 

the  photometric  function.  To  this  end,  we  will  develop  an  algorithm  that  attempts  to  separate 
the  Lambertian  and  specular  components  of  each  measured  image  intensity,  and  computes 
surface  orientations  by  using  the  methods  given  above  for  Lambertian  and  specular  surfaces. 

The  extraction  algcnithm  is  based  on  two  constraints,  namely,  the  sampling  frequency 
constraint  and  the  unique  orientation  constraint.  By  sampling  the  modified  photometric 
function  at  the  minimum  sampling  frequency  we  can  ensure  that  only  two  consecutive 
image  intensities  in  the  intensity  set  {/'i}  contain  non-zero  specular  components  of  intensity. 
For  each  k  in  the  interval  0  <  k  <  M,  ft  and  fk+i  are  hypothesized  as  being  the  two 
intensities  that  are  corrupted  by  specular  components.  All  remaining  intensities  in  the  set  {/i: 

is  1,2, . M}  must  represent  only  Lambertian  components  of  reflection.  These  intensities  are 

used  to  compute  the  surface  orientation  ^  ^  and  the  Lambertian  strength  A'.  The  Lambertian 
components  /LV  and  IL\^\  are  determinet  <sed  to  separate  the  specular  components  /5  k 
and  /5'k+i  from  and  /'k+i,  respective  >  i  -^ace  orientation  and  specular  strength 

B'  are  computed  from  IS\  and  /^k+i  b>  .  ^  ^  pecular  reflectance  model. 

Next,  the  physical  constraint  tha.  -  ace  point  has  a  unique  orientation  is  ex¬ 

ploited.  An  estimate  0,^  of  the  orientation  ^  as  a  weighted  average  of  the  orientations 
6^  and  d„|.  The  weights  are  proportionate  to  the  strengths  of  the  two  components  of  re¬ 
flection.  We  support  this  method  of  weight  selection  because  the  surface  orientation  that  is 
computed  from  intensities  resulting  from  the  stronger  of  the  two  reflection  components  is  less 
sensitive  to  image  noises  and  is,  therefore,  more  reliable.  An  orientation  error  e^  is  found 
by  comparing  6^^  with  and  6m,  The  orientation  error  is  computed  for  every  k,  where  0 
<  k  <  M.  The  surface  orientation  and  reflectance  strengths  computed  for  the  value  of  k  that 
minimizes  Ck  are  assigned  to  the  surface  point  under  consideration.  This  process  is  repeated 
for  all  points  on  the  object  surface. 

It  is  imponant  to  note  that  the  following  algorithm  is  not  only  capable  of  determining 
shape  and  reflectance  properties  of  hybrid  surface  but  also  Lambertian  and  specular  surfaces. 


Extraction  Algorithm 

Step  1:  Let  k  =  1  and  eo  equal  a  large  positive  number. 

Step  2:  Hypothesize  that  image  intensities  /'k  and  /'k-ci  consist  of  specular  components  of 
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reflection.  All  intensities  /'j,  where  i  k  and  i  76  k+1,  and  the  Lambertian  component  of  the 
photometric  function  are  used  to  compute  the  surface  orientation  9^  and  Lambertian  strength 
A'k  (section  3.1). 


Step  3:  The  specular  components  /5'k  and  IS'm  are  separated  fiom  the  image  intensities 
and/'k-^i: 

/5'k  =  -  A\cos{e\,  -  9^) , 

/S'k+I  =  /'k+l  —  A'k  COA(dk+l  —  ^nl)  •  (26) 

If  /5'k  <  0  or  IS\^\  <  0,  set  k  =  k  +  1  and  go  to  step  2. 


Step  4:  The  surface  orientation  ^ni  and  the  strength  of  the  specular  reflection  B\  are  de¬ 
termined  by  using  specular  intensities  /5'k  and  IS'm  and  the  specular  component  of  the 
photometric  function  (section  3.2). 


Step  5:  We  have  separated  the  Lambertian  and  specular  components  from  the  set  of  measured 
image  intensities  and  computed  the  surface  orientations  9^  and  9nt  by  using  the  Lamoertian 
and  specular  reflectance  models,  respectively.  The  best  estimate  of  surface  orientation,  for 
the  k*  iteration,  is  determined  as: 


^nk 


A'k  ^oi  +  B\  9nt 
A\  +  B\ 


(27) 


The  orientation  at  the  surface  point  under  consideration  is  unique.  Therefore,  if  we  have 
correctly  selected  intensities  fk  and  /'k^t  ^  the  two  intensities  that  contain  non-zero  specular 
components,  then  9^,  9^,  and  ^ok  must  be  equal  to  one  another.  An  orientation  error  Ck  is 
defined  as: 


«k 


A\  I  ^nl  —  ^nk  I  B'k  I  ^ni  ~  ^nk  | 
A'k  +  B\ 


(28) 


Step  6:  If  Ck  <  ^k-it  titen: 


~  ^nk , 

A'  =  A'k, 

B'  =  B\. 

If  k  <  M-l,  set  k  3  k  +  1  and  go  to  step  2.  Else,  stop. 


(29) 
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4  Extension  to  Three  Dimensions 


In  the  previous  sections,  photometric  sampling  was  described  in  two  dimensions.  Hgure  6 
illustrates  the  point  source  illuminadon  of  a  surface  element  in  three  dimensions.  All  vectors 
are  represented  by  the  two  parameters  6  and  0  where  $  is  the  azimuth  angle  and  V’  is  the 
longitudinal  angle.  We  shall  refrain  from  presenting  detailed  derivations  of  all  the  equations 
fOT  the  three-dimensional  case  and  rather  describe  the  final  forms  of  the  relevant  equadohs. 


Figure  6:  Surface  illuminadon  and  imaging  in  three  dimensions.  Surface  orientation  and 
source  direcdon  are  represented  by  the  two  parameters  9  and  0. 
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4.1  Basic  Photometric  Function 


In  Figure  6,  the  point  source  5  is  located  in  the  direction  (^„  t/’Oand  the  surface  normal 
vector  n  points  in  the  direction  (^b,  V>n)-  The  Lambertian  component  of  the  basic  photometric 
function  is  a  cosine  fimction  of  the  angle  0  between  the  surface  normal  vector  n  and  the 
point  source  direction  vector  s.  We  have  assumed  the  specular  reflectance  model  to  be  a  unit 
impulse  funcdon.  Since  directions  are  represented  by  the  two  parameters  6  and  the  specular 
component  of  the  photometric  function  for  the  three-dimensional  geometry  is  expressed  as 
a  double-impulse  function.  Therefore,  for  point  source  illumination,  the  three-dimensional 
photometric  function  may  be  written  as: 

I  -  A  COS0  +  B  u0t  —  m(0,  -  ip„) .  (30) 

By  using  spherical  trigonometry,  the  term  cos0  may  be  determined  from  the  surface  normal 
direction  and  the  source  direction  as: 

COS0  -  cosBaCosB,  +  sindaSin6tCos(ipt  -  ipn)-  (31) 

4.2  Photometric  Function  for  Extended  Sources 

The  radiance  function  for  a  three-dimensional  extended  source  is  given  in  Appendix  A.2.  The 
photometric  function  for  extended  source  illumination  is  obtained  by  convolving  the  basic 
photometric  function  fid,4>)  with  the  extended  source  radiance  function  L(0,  rp,  0,).  Since 
each  radiance  funcdon  L(d^  V*,  B$i  is  symmetric  about  the  corresponding  source  direcdon 
(9,,  iht),  the  Lambertian  component  of  the  modified  photometric  function  is  a  cosine  function 
of  the  angle  between  the  extended  source  direction  (0„  ipt)  and  the  surface  normal  direction 
(^n,  0n)'  The  specular  component  of  the  modified  photometric  function  is  proportional  to  the 
extended  source  radiance  in  the  direction  (2^a»V’n)-  Therefore,  the  photometric  function  for 
surface  illumination  by  the  extended  source  L(^,  i’t)  is: 

r  =  A'  COSI3  +  L(2^b,  V-n,  t^.) .  (32) 


4.3  Sampling 

Samples  of  the  modified  photometric  function  can  be  obtained  by  illuminating  the  object 
surface  from  different  source  directions.  An  extended  source  can  be  moved  to  different 
locations  around  the  object  and  an  image  of  the  object  obtained  for  each  source  direction. 
Alternatively,  a  number  of  extended  sources  can  be  distributed  around  the  object  and  an 
image  of  the  object  taken  for  each  extended  source.  A  uniform  sampling  of  the  photometric 
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function  may  be  obtained  by  distributing  extended  sources  in  a  tessellation  that  results  from 
projecting  onto  the  unit  sphere  regular  polyhedra  whose  centers  coincide  with  that  of  the 
sphere  [1]. 

4.4  Extracting  Shape  and  Reflectance  of  Surfaces 

Though  the  basic  principle  used  by  the  extraction  algorithm  remains  unchanged  for  the 
three-dimensional  case,  a  few  modifications  are  necessary  to  accommodate  for  the  additional 
degree  of  freedom  given  to  surface  orientation  by  the  parameter  0.  If  the  object  surface  is 
known  to  be  purely  Lambertian,  an  error  minimization  similar  to  the  one  used  in  the  two- 
dimensional  case  may  be  used  to  fit  the  Lambertian  reflectance  model  to  the  image  intensities 
{/'{}  to  determine  the  Lamberdan  strength  A'  and  the  surface  orientation  (dn,  0n)-  On  the 
other  hand,  if  the  surface  is  purely  specular,  orientation  can  be  determined  from  the  non-zero 
photometric  samples.  If  extended  sources  are  distributed  in  the  icosahedron  tessellation,  any 
three  adjacent  point  sources  will  constitute  the  vertices  of  an  equilateral  triangle.  If  adjacent 
sources  are  separated  by  the  source  termination  angle  a,  the  samples  measured  at  a  specular 
surface  point  will  have  three  non-zero  intensities  (see  Appendix  A.2). 

The  extraction  algorithm  for  the  three-dimensional  geometry  is  once  again  based 
on  the  sampling  frequency  and  unique  orientation  constraints.  It  assumes  that  only  three 
image  intensities  /\>i,  and  generated  by  three  adjacent  extended  light  sources, 
can  contain  non-zero  specular  components  of  intensity.  All  remaining  intensities  in  the  set 
{/'i}  must  represent  only  Lambertian  reflection.  These  intensities  are  used  to  compute  the 
surface  orientation  (^„i,  0ni)  and  the  Lambertian  strength  A\.  The  Lambertian  components 
IL\,  and  are  computed  and  used  to  separate  the  specular  components  /5'ic, 
and  IS\^2  from  and  I'm,  respectively.  Next,  the  surface  orientation  i6„,xpnt)  and 

the  specular  strength  are  computed  from  /5'k,  IS'^t  and  IS'm  by  using  the  the  specular 

reflectance  model.  We  use  the  physical  constraint  that  each  surface  point  has  a  unique 
surface  orientation.  An  estimate  0,^,  0„k)  of  the  orientation  is  found  as  a  weighted  sum  of 
the  orientations  (^ni«  0ni)  and  0^  0Df)«  and  an  orientation  error  is  computed  as  a  function  of 
the  deviations  of  (^nk,  0nk)  from  (^,u,  0ni)  and  0m,  0ni).  This  process  is  repeated  for  every  set 
of  three  adjacent  sources,  and  the  surface  orientation  and  reflectance  strengths  that  minimize 
the  orientation  error  are  assigned  to  the  surface  point.  The  extraction  algorithm  is  executed 
for  each  point  on  the  object  surface. 
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5  Experimental  Results 

5.1  Experimental  Set*Up 

We  have  conducted  experiments  to  demonstrate  the  practical  feasibility  of  the  photometric 
sampling- concept -A  two-dimensional  illustration  of  photometric  sampling  is  shown  in 
Figure  7-  The_  object  is  placed  at  the  center  of  a  spherical  diffuser  and.  is  viewed  by  the 
camera  through  a  hole  in  the  diffuser.  Point  sources  of  light  are  uniformly  distributed  outside 
the  diffuser.  All  point  sources  have  the  same  radiant  intensity  and  are  equidistant  from  the 
center  of  the  diffuser.  Sampling  is  done  at  the  minimum  sampling  frequency  determined  by 
equation  17.  Hence,  adjacent  point  sources  are  separated  by  the  source  termination  angle 
a  and  each  extended  source  has  a  angular  width  of  2a.  The  radiance  functions  of  adjacent 
extended  sources  overlap  each  other  for  a  period  of  a. 


Figure  7:  Physical  realization  of  photometric  sampling  in  two  dimensions. 

A  photograpi'.  of  the  experimental  set-up  used  to  implement  photometric  sampling, 
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is  shown  in  Figure  8.  A  14-inch  diameter  lamp  shade  is  used  as  the  spherical  diffuser, 
and  extended  light  sources  are  generated  on  the  diffuser’s  surface  by  illuminating  it  using 
incandescent  light  bulbs.  The  object  is  placed  at  the  center  of  the  diffuser  and  is  viewed  by  a 
camera  through  a  1-inch  diameter  hole  in  the  surface  of  the  diffuser.  The  current  set-up  uses 
a  WV-22  model  Panasonic  CCD  camera  that  has  a  512x480  pixel  resolution.  The  complete 
imaging  system,  comprising  of  lenses  and  camera,  has  a  physical  resolution  of  0.002  inches 
per  pixel  width.  In  the  current  implementation,  the  light  bulbs,  camera,  and  object  are  all 
placed  in  the  same  plane.  This  two-dimensional  set-up  is  only  capable  of  measuring  the 
orientation  of  surface  normal  vectors  that  lie  on  a  single  plane  in  orientation  space.  For  each 
extended  source,  an  image  of  the  object  is  digitized  and  stored  in  memory.  The  sequence  of 
object  images,  generated  by  scanning  the  array  of  extended  sources,  is  processed  using  the 
extraction  algorithm  that  is  coded  on  a  3/60  SUN  work-station.  The  surface  orientation  and 
reflectance  information  produced  by  the  extraction  algorithm  is  color-coded  and  displayed 
on  a  color  monitor. 


Figure  8:  Photograph  of  the  experimental  set-up  used  to  Icmonstrate  the  photometric  sam¬ 
pling  concept. 
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5.2  Sampling  Photometric  Functions 

The  experimental  set-up  was  used  to  extract  the  surface  properties  of  a  number  of  objects. 
In  order  to  show  that  the  measured  intensities  are  consistent  with  the  theory  developed  in  the 
previous  section,  we  will  first  present  plots  of  measured  samples  of  the  photometric  function 
for  surfaces  of  different  reflectance  properties.  Figure  9  shows_the  image  intensities  diat 
were  measured  at  a  single  pixel,  plotted  as  a  fiinction  of  the  extended  source  direction.  The 
measured  intensity  values  are  represented  by  black  dots.  The  surface  pmht  under  consider¬ 
ation  is  specular  and,  as  expected,  only  two  consecutive  sources  in  the  entire  array  produce 
image  intensities  that  are  significantly  greater  than  zero.  Figure  10  shows  a  similar  plot  for  a 
Lambertian  surface  point.  To  prove  that  the  intensities  describe  a  cosine  function,  the  cosine 
function  that  best  fits  the  intensities  is  superimposed  on  the  same  plot  and  is  represented  by 
a  solid  curve.  The  measured  intensities  are  observed  to  lie  in  close  proximity  to  the  cosine 
function.  Since  Lambertian  and  specular  surfaces  produced  intensity  values  that  appeared  to 
be  consistent  with  their  reflectance  models,  similar  experiments  were  conducted  on  hybrid 
surfaces.  Figure  11  shows  photometric  samples  measured  at  a  point  on  the  surface  of  a 
plastic  object  whose  reflectance  model  includes  both  Lambertian  and  specular  components. 
The  orientation  of  the  surface  point  was  known  a-priori,  and  thus  the  two  measured  samples 
that  were  expected  to  consist  of  both  Lambertian  and  specular  intensities  were  identified  and 
are  marked  in  the  figure  as  "L+S".  All  remaining  image  intensities  tesult  from  Lambertian 
reflection  and  are  maiked  in  the  figure  as  "L".  The  cosine  function  that  best  fits  the  Lamber¬ 
tian  intensities  is  represented  by  the  solid  curve.  The  specular  components  were  extracted 
from  the  two  intensities  that  are  marked  as  "L-fS".  Two  estimates  of  surface  orientation  were 
computed  using  the  Lambertian  and  the  specular  components  of  the  image  intensities.  Both 
computed  orientations  were  found  to  be  within  3  degrees  of  the  actual  orientation  value. 

5.3  Lambertian,  Specular,  and  Hybrid  Surfaces 

On  the  basis  of  the  above  experiments,  the  extraction  algorithm  was  implemented  and  surface 
properties  of  a  large  number  of  objects  were  extracted.  Figures  12  through  31  show  the 
results  of  the  extraction  method  applied  to  objects  of  varying  surface  reflectance  properties. 
For  each  object,  a  photograph  of  the  object  is  followed  by  a  needle  map  and  two  reflectance 
images  produced  by  the  extraction  algorithm.  A  needle  map  is  a  representation  of  surface 
orientations.  At  each  point  on  a  needle  map,  the  length  of  the  needle  is  proportional  to  the 
tilt  of  the  surface  away  from  the  viewing  direction  of  the  camera.  The  direction  in  which 
each  needle  points  is  determined  by  locating  the  starting  point  of  the  needle.  All  needles 
originate  from  the  dots  that  constitute  the  resolution  grid  of  the  needle  map.  In  all  the 
needle  maps  shown  in  this  paper,  the  needles  always  appear  horizontally  oriented  because 
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only  a  two-dimensional  illuminadon  geometry  has  been  implemented.  Therefore,  only  those 
surface  normal  vectors  that  are  oriented  parallel  to  the  plane  of  illumination  can  be  measured. 
The  reflectance  properties  of  the  surfaces  are  given  by  two  images,  namely,  the  Lambertian 
strength  image  and  the  specular  strength  image.  The  intensity  at  each  pixel,  in  either  of 
these  two  images,  is  proportional  to  the  strength  of  the  reflectance  component  the  image 
represents.  For  example,  a  Lambertian  surface  point  would  have  maximum  intensity  in  the 
Lambenian  strength  image  and  zero  intensity  in  the  specular  strength  image,  and  specular 
surface  point  would  have  maximum  intensity  in  the  specular  strength  image  and  zero  intensity 
in  the  Lambertian  strength  image.  Hybrid  points  would  have  non-zero  intensities  in  both 
Lambenian  and  specular  strength  images. 

The  object  shown  in  Figure  12  is  a  prism  and  its  surface  is  Lambenian.  The  object 
shown  in  Figure  16  is  cylindrical  and  its  surface  is  also  Lambenian.  Figure  20  shows  a 
prism  that  has  a  highly  specular  surface.  An  interesting  application  for  the  proposed  method 
is  seen  in  objects  such  as  the  one  shown  in  Figure  24.  The  object  is  a  metal  bolt  that  has  a 
hexagonal  head,  and  the  painted  surface  of  the  head  is  Lambertian  in  reflection.  The  threaded 
section  of  the  bolt  has  a  specular  surface.  Surface  orientations  are  measured  only  along  the 
thin  edges  of  the  threads  since  surface  orientations  in  the  grooves  between  threads  lie  outside 
the  range  of  orientations  that  the  current  two-dimensional  system  is  capable  of  measuring. 
While  generating  needle  maps,  surface  orientations  ate  sampled  to  make  room  for  the  display 
of  needles.  During  sampling,  a  considerable  number  of  orientations  measured  on  the  threads 
of  the  bolt  are  lost.  In  order  to  get  a  better  picture  of  the  shape  of  the  threaded  section, 
orientations  measured  on  a  few  threads  are  displayed  at  a  higher  resolution. 

All  the  above  experiments  were  conducted  on  surfaces  constituting  points  that  were 
either  Lambertian  or  specular.  A  major  advantage  of  the  photometric  sampling  method, 
over  all  existing  shape  extraction  techniques,  lies  in  its  ability  to  determine  the  shape  and 
reflectance  of  hybrid  surfaces.  Plastic  objects  seem  to  fit  the  description  of  hybrid  surfaces 
given  earlier  in  this  paper.  Figure  28  shows  the  photo  of  a  cylindrical  plastic  object.  The 
needle  map  of  the  object,  generated  by  the  extraction  algorithm,  is  consistent  with  the  actual 
shape.  As  expected,  non-zero  Lambertian  and  specular  strengths  are  noted  in  the  reflection 
images  of  the  plastic  surface.  An  important  feature  of  all  the  above  results  is  that  the  surface 
properties  computed  at  a  pixel  are  solely  based  on  the  intensities  recorded  at  that  pixel.  The 
needle  maps  and  reflectance  images  have  not  been  subjected  to  any  filtering  operations. 

5.4  Measurement  Accuracy  and  Processing  Time 

A  simple  error  analysis  was  conducted  to  estimate  the  measurement  accuracy  of  the  current 
set-up.  In  the  results  obtained  so  far,  the  surface  orientations  were  found  to  be  within  4 
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degrees  of  the  actual  orientation  values,  and  an  average  error  of  2  degrees  in  orientation  was 
estimated.  The  accuracy  of  the  system  is  an  improvement  over  other  extraction  methods 
that  also  use  photometric  measurements  [16],  due  to  the  use  of  a  large  number  of  sources, 
rather  than  a  single  source  as  in  shape  from  shading  or  three  sources  in  photometric  stereo. 
As  the  number  of  measured  photometric  samples  increases,  better  estimates  of  shape  and 
reflection  parameters  are  expected.  The  extraction  algorithm  computes  surface  properties  at 
a  rate  of  approximately  1  milli-second  per  image  pixel  on  a  3/60  SUN  work-station.  The 
current  extraction  program  may  be  optimized  to  improve  the  execution  time. 


6  Conclusions 

We  have  presented  photometric  sampling  as  a  method  for  determining  the  shape  of  Lamber¬ 
tian,  specular,  and  hybrid  surfaces.  Surface  shape  is  determined  without  prior  knowledge  of 
the  reflectance  properties.  Active  surface  illumination,  using  extended  light  sources,  makes 
it  possible  to  capture  both  Lambertian  and  specular  reflections  in  the  image  intensities.  Sur¬ 
face  orientations  and  reflectance  parameters  are  computed  by  using  the  sampling  frequency 
constraint  and  the  unique  orientation  constraint.  Accurate  estimates  of  surface  orientations 
are  obtained  by  using  both  Lambertian  and  specular  components  of  the  image  intensities.  At 
each  surface  point,  shape  and  reflectance  properties  are  computed  using  only  image  intensi¬ 
ties  measured  at  that  point.  As  a  result,  no  shape  constraint  arc  needed  while  determining 
surface  properties. 

The  photometric  sampling  method  may  be  used  to  automate  a  variety  of  inspection 
tasks.  In  many  industrial  processes,  the  quality  of  a  manufactured  pan  is  determined  by  its 
shape  and  reflectance  properties.  The  shape  of  a  manufactured  pan  may  be  inspected  using 
the  measured  surface  orientations,  while  the  smoothness  or  roughness  of  its  machined  surface 
may  be  determined  from  the  extracted  reflectance  properties. 
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Figure  9:  Photometric  samples  measured  at  a  specular  surface  point.  The  measured  intensities 
are  plotted  as  a  function  of  the  extended  source  direction  di. 
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Figure  10:  Photometric  samples  measured  at  a  Lambertian  surface  point.  The  cosine  function 
that  best  fits  the  measured  intensities  is  shown  as  a  solid  curve. 
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Figure  11:  Photometric  samples  measured  at  a  hybrid  surface  point.  By  using  the  known 
orientation  of  the  surface  point,  the  two  intensities  corrupted  by  specular  reflections  were 
identified  and  marked  "L+S".  The  remaining  points  result  solely  from  Lambertian  reflection 
and  the  cosine  function  that  best  fits  these  points  is  shown  as  a  solid  curve. 
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Figure  12:  Photo  of  a  prism  that  has  a  Lambertian  surface. 
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Figure  13:  Needle  map  for  the  object  shown  in  Figure  12. 
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Figure  14:  Lambertian  strength  image  for  the  object  shown  in  Figure  12. 


Figure  15:  Specular  strength  image  for  the  object  shown  in  Figure  12, 
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Figure  17;  Needle  map  for  the  top  cylindrical  surface  of  the  object  shown  in  Figure  16. 
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Figure  19:  Specular  strength  ii.iagc'ior  the  object  shown  in  Figure  16. 


Figure  22:  Lambertian  strength  image  for  the  object  shown  in  Figure  20. 


Figure  23:  Specular  strength  image  for  the  object  shown  in  Figure  20. 
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Figure  24:  Photo  of  a  metal  bolt.  The  head  of  the  bolt  is  hexagonal  and  has  a  Lambertian 
surface,  while  the  threaded  section  of  the  bolt  has  a  specular  surface. 
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Figure  26:  Lambertian  strength  image  for  the  object  shown  in  Figure  24. 


Figure  27;  Specular  strength  image  for  the  object  shown  in  Figure  24, 
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Figure  28;  Photo  of  a  cylindrical  plastic  object  that  has  a  hybrid  surface. 


Figure  29:  Needle  map  for  the  object  shown  in  Figure  28, 


A  Generating  Extended  Sources 


A.1  Two-Dimensional  Source 


An  extend^  U^t  source  can  be  generated  by  illuminating  a  sheet  of  light-diffusing  material 
V^th  a  i^int  light  squric^/  Figure  32  iUus  the  illumination  of  a  SMtibn  of  ai  circular 
diffuser  of  radius  /?.  The  point  source  is  placed  at  a  distance  H  from  the  diffuser’s  surface^ 
and  the  inspected  object  is  placed  at  the  center  of  the  circle.  The  light  radiance^  L(9, 6^)  of 
the  inner  surface  of  the  diffuser,  due  to  the  point  source  5,  is  proportional  to  the  irradiance^ 
E($,  $t)  of  the  outer  surface  Of  the  diffuser. 


Ue,6,)^CE{6,9,).  (33) 

where  C  is  a  constant  of  proportionality.  The  analytic  expression  for  the  surface  irradiance 
E{9, 9t)  may  be  derived  from  the  basics  of  radiometry  as: 


E(9,9,) 


Icos</> 


(34) 


where  I  is  the  radiant  intensity^  of  the  point  source  S.  The  radiance  of  the  extended  source 
may  be  determined  by  expressing  the  variables  r  and  in  equation  34  in  terms  of  the 
parameters  /?,  ff,  and  9t  of  the  illumination  geometry: 


L(9  9  ^  Cm  +  H)cos(9^9,)-R] 

^  ”[(/?  +  //-  RcosiS  -  ^,))2  +  iRsini9  -  ^,))2p/2' 


(35) 


The  radiance  function  1(9, 9,)  is  symmetric,  or  even,  with  respect  to  9  ^  9t,  and  its 
magnitude  decreases  as  9  deviates  from  9^.  Points  on  the  diffuser  that  lie  in  the  interval  9,-0 
<9  <  9i+a  receive  light  from  the  point  source  5.  Points  on  the  diffuser  that  lie  outside  this 
interval  are  occluded  from  the  point  source  by  points  that  lie  in  the  interval.  Thus,  L(9, 9,) 
=  0  for  ^  <  9rQ  and  9  >  9,+a.  The  source  termination  angle  a  may  be  determined  from 
Figure  32  as: 


^Radiance  is  defined  as  the  flux  emitted  per  unit  foreshortened  surface  area  per  unit  solid  angle.  Radiance 
is  measured  in  watts  per  square  meter  per  steradian 

^Irradiance  is  defined  as  the  incident  flux  density  and  is  measured  in  watts  per  square  meter 
^Radiant  Intensity  of  a  source  is  defined  as  the  flux  exiting  per  unit  solid  angle  and  is  measured  in  watts 
per  steradian  (W.jr~‘), 
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Figure  32:  Two-dimensional  extended  source. 

A.2  Three-Dimensional  Source 

Figure  33  illustrates  the  generation  of  a  three-dimensional  extended  source.  A  spherical 
diffuser  is  illuminated  with  a  point  source  of  light.  The  radiance  Li.6,  9t,  rpt)  of  the  inner 

surface  of  the  diffuser,  due  to  point  source  5,  is  determined  as: 

ClHR’^-H)cos0-R] 


L{$,  Ot, 


[{R*H-R cos^)^  +  {R ’ 


where: 


COS0  a  cos6,  cos6  +  sin9t  sin0  cosirj;  —  V’l) 


sin0  ■  \/l  -  [cos0]^ . 

The  radiance  function  L(9,  ip,  ipt)  h  symmetric  about  the  point  source  direction  t^,). 
Points  on  the  diffuser  that  have  equal  radiance  values  lie  on  concentric  circles.  The  magnitude 
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of  ue,  0,  V’l)  decreases  as  (^,  i/>)  deviates  from  (d„  t^,),  and  L(d,  0,  V'l)  *  0  for  /5  >  a. 
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Figure  33;  Three-dimensional  extended  source. 

We  have  chosen  a  spherical  diffuser  since  it  produces  symmetrical  extended  sources. 
Funher,  an  array  of  extended  sources  is  realized  by  simply  distributing  point  sources  around 
the  spherical  diffuser  and  placing  the  object  at  the  center  of  the  diffuser.  All  extended  sources 
in  the  array  would  have  identical  radiance  characteristics  if  all  point  sources  have  the  same 
radiant  intensity  and  are  positioned  at  equal  distances  from  the  surface  of  the  spherical 
difruser. 

The  tessellation  used  to  distribute  the  extended  sources  is  critical  from  the  perspective 
of  detecting  of  specular  reflections.  A  specular  surface  point  with  orientation  will  re¬ 

flect  light,  from  the  point  (29a,tlfn)  on  the  diffuser,  into  the  camera.  As  in  the  two-dimensional 
case,  the  location  of  the  point  (20n,^n)  can  be  determined  from  the  non-zero  image  intensities 
measured  at  the  specular  surface  point.  If  extended  sources  are  distributed  in  the  icosahedron 
tessellation,  any  three  adjacent  point  sources  will  constitute  the  vertices  of  an  equilateral  tri¬ 
angle.  Let  us  assume  that  adjacent  sources  are  separated  by  the  source  termination  angle  a. 


As  shown  in  Figure  34,  the  point  on  the  diffuser  that  lies  in  the  direction  (2^ni0n) 
illuminated  by  point  sources  5k,  Sk^-t*  and  Sk^i*  'Hierefore,  for  a  specular  surface  point 


orientation  {6n,^n),  the  image  intensities  fkt  /'k-i-if  and  I\^2  will  be  the  non-zero  intensities  in 
the  set  {fi}.  Since  the  radiance  function  L{6^rjf,9u  rl;t)  decreases  in  magnitude  as  we  move 
away  from  the  point  source  direction  (9,,  0,).  the  normalized  brightness  difference  function 
can-be  modified  to  help  determine  the  point-(2^n,V'n)  -from-the  thrM  image  intensities-fk* 
/'k+i,  and  r k+2. 


Figure  34:  The  point  on  the  surface  of  the  diffuser  lies  on  the  extended  sources 

generated  by  point  sources  5k,  Sk^-i,  and  5k«2- 
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